Easiest way to Control your Smart Home with AI - Ollama + Home Assistant 
Beginner DIY ESPHome mmWave Presence Sensor 
Install Integration version with Gemini Vision Support#
Download if from here
Home Assistant version 2024.2 is out, and it brings support for Gemini Vision built in.
You can safely remove the Custom Integration files
Google AI API Key#
First you need to generate an API key to use with the integration, you can generate yours here.
Gemini Vision is running on Google Cloud using the Vertex AI Conversation API
Is free to use for now, but Google may enforce rate limits during this period.
Google IA Conversation Integration#
You can use this button to start the setup process. It will open the integration page in Home Assistant.
This integration allows you to use the Google AI Conversation API to generate text. You can use this to generate personalized messages for automations and scripts.
You can find the documentation here.
Sentinel Sight: Blueprint#
AI-Powered Vigilance with Gemini Vision
Install Visual Studio Code Add-on#
Enable Home Assistant to access the /tmp directory#
The blueprint uses the /tmp directory to store the images to be processed by Gemini Vision.
This folder becomes empty every time you restart Home Assistant, so it's safe to use it.
To enable access to the /tmp directory, you need to add the following to your configuration.yaml file:
homeassistant/configuration.yaml
homeassistant:
allowlist_external_dirs:
- /tmpYou can buy the blueprint and support the channel by clicking the button
I would love to hear your comments, or suggestions on this post.
Fixt is a Software Engineer passionate about making the world a better place through technology and automation.